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METHOD AND SYSTEM FOR PROVIDING A VOLUMETRIC 
REPRESENTATION OF A THREE-DIMENSIONAL OBJECT 

The present invention relates to methods and systems for providing three- 
5 dimensional representations and will be described below with reference to this 
application. However, it will be appreciated that the invention is not limited to this 
particular field of use. 

Several methods for providing volumetric representations of three- 
dimensional objects are known in the art. An example of a method for providing 

10 volumetric representations of three-dimensional objects includes providing a 

three-dimensional (3D) shape reconstruction of objects from multiple views. The 
computation of the visual hull from object silhouettes is a popular technique. 

The method, also called shape-from-silhouette, delivers a 3D description of 
the object. The approach requires a set of silhouette images from calibrated 

15 cameras. A silhouette image is a binary (or in some cases, grey scale) image 
where each pixel indicates whether this pixel belongs to the object or not. The 
silhouette information can be determined by any suitable segmentation process. 
This is advantageously done using chroma-keying or difference-keying as 
described in our GB-0220972.4 and our earlier applications referred therein. 

20 The 3D shape reconstruction can be formulated as the intersection of 

generalised cones of the silhouette images. A generalised cone is the union of 
visual rays from all silhouette points of a particular image. This intersection gives 
only an approximation of the real object shape and is called the visual hull. In 
particular concavities cannot be modelled with this method. 

25 Several algorithms have been published for the computation of the visual 

hull, for example: W. Martin and J. K. Aggarwal, "Volumetric descriptions of 
objects from multiple views," IEEE Transactions on Pattern Analysis and Machine 
Intelligence, vol. 5, no. 2, pp. 150-158, March 1983; M. Potmesil, "Generating 
octree models of 3D objects from their silhouettes in a sequence of images," 

30 Computer Vision, Graphics and Image Processing, vol. 40, pp. 1-29, 1987; 
Richard Szeliski, "Rapid octree construction from image sequences," CVGIP: 
Image Understanding, vol. 58, no. 1, pp. 23-32, July 1993; and Wolfgang Niem, 
"Robust and fast modelling of 3d natural objects from multiple views," in SPIE 



Proceedings, Image and Video Processing II, San Jose, February 1994, vol. 
2182, pp. 388-397. These approaches attempt to solve the problem in a 
volumetric space representation. The most common of these representations is to 
subdivide a 3D box in euclidian 3-space into a set of voxels of discrete size. The 
5 size of the box is predetermined such that the object can fit inside. In order to 
save memory these may be represented as "octrees" or are run-length encoded. 

For the use of the 3D reconstruction, e.g. in a computer graphic application, 
a surface description, usually a polygonal mesh has to be generated. An often 
used algorithm is the marching cubes algorithm, described in US Patent Nos. 

10 4,710,876 and 4,885,688, which creates an iso-surface of a volumetric data set. 
Since the mentioned shape-from-silhouette methods compute binary voxels the 
3D surfaces generated from those using the marching cube algorithm are very 
noisy. This noise is introduced due to spatial discretisation of the volumetric 
representations. That is to say, real data as the actual shape of the object is lost 

1 5 during the processing of the algorithm. 

According to one aspect of the invention there is provided a method of 
providing a volumetric representation of a three-dimensional object, the method 
comprising: 

obtaining a line list of points of at least one set of lines having start and end 
20 points corresponding to intersection of the lines with object boundary positions; 
obtaining an approximate volumetric representation of the object; and 
producing a modified volumetric representation by modifying the 
approximate volumetric representation based on the start and end points of the 
set of lines and the approximate volumetric representation. 
25 The resultant modified volumetric representation of the object is more . 

accurate than the approximate volumetric representation of the object. Also, a 
resultant data set from the present invention that defines the volumetric 
i representation of the object contains continuous data as to the shape of the 
object, rather than mere discrete data. Therefore, the resultant data set contains 
30 more realistic data defining the object. 

Preferably, at least two two-dimensional images of the object are obtained 
and the object boundary positions are defined by edges of the object in the at 



least two two-dimensional images. The two-dimensional images provide a 
straightforward medium with which to define the object edges. 

Preferably, the at least one set of lines is projected into at least one of the 
•images to determine which of the lines intersect the edges. Preferably, the line 
list of points is determined by the points where the lines intersection the edges, 
and the points are start and end points of line segments of the lines that intersect 
the edges. Thus, the data set of the line list of points is relatively small, 
compared with a complete data set of points defining the object in its entirety. 

Preferably, the approximate volumetric representation is obtained by 
projecting the at least two images of the object into an array of voxels, 
determining in which of the voxel(s) one or more of the edge(s) of the object 
intersects therewith, and producing a voxel list thereof. Preferably, the line list(s) 
are used to determine at least some locations on voxel edges of respective voxels 
in the voxel list to produce a voxel edge intersection list, and the voxel edge 
intersection list is used to produce the modified volumetric representation. Also 
preferably, the start and end points of the line segments are used to determine at 
least some locations on voxel edges of respective voxels in the voxel list to 
produce a voxel edge intersection list, and the voxel edge intersection list is used 
to produce the modified volumetric representation. Data for the modified 
volumetric representation may therefore be produced relatively efficiently. 

Preferably, the modified volumetric representation is produced to have at 
least some voxel edges which more accurately match object edges than in the 
approximate representation. 

Preferably, the approximate volumetric representation is obtained using a 
marching cubes procedure. Also preferably, the start and end points are used to 
modify the spatial positions of triangle vertices of triangles produced by the 
marching cubes procedure on the triangle vertices' respective voxel edges: 
Whereas the*narching cubes procedure is efficient, the ability of the invention to 
modify the spatial positions of the triangle vertices allows for a comparatively 
more accurate representation of the object to be achieved. Also, whereas the 
data produced from the marching cubes procedure is discrete, data from the 
present invention is continuous, and therefore information regarding the object is 
not lost by comparison. 
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Preferably, the images are produced by a chroma-key process. In one 
embodiment, the images are binary images. Preferably, initial images are 
obtained by at least one camera for conversion to the images. Also preferably, 
the initial images are obtained using a plurality of said cameras in a studio, and 
5 the studio includes a retro-reflective background behind the object. The chroma- 
key process allows for ease of producing an image for use with the present 
invention. 

Preferably, the start and end points and the position and direction of the 
lines are estimated with respect to a position of the camera when obtaining the 
10 images. Therefore, provided the location of each camera is known, it is not 
necessary for the cameras to be in the same position each time a volumetric 
representation is required. 

In an alternative embodiment, there are 3 pairs of images, wherein the 
images of each pair lie in a parallel plane, and the plane of each respective image 
1 5 of each pair is normal to the planes of the remaining pairs. 

Preferably a texture map is applied to the volumetric representation. 
According to a second aspect of the present invention there is provided a 
method for providing a moving volumetric representation of an object, the method 
comprising obtaining a plurality of volumetric representations of a three- 
20 dimensional object using the method of any one of the preceding claims, where 
each volumetric representation represents a different phase of movement of the 
object over time, and consecutively displaying each volumetric representation in a 
manner to produce to a viewer the sensation that the volumetric representation of 
the object is moving. 
25 According to a third aspect of the present invention there is provided a 

system for providing a volumetric representation of a three dimensional object, 
the system comprising: 

means for obtaining a line list of points of at least one set of lines having 
start and end points corresponding to intersection of the lines with object 
30 boundary positions; 

means for storing the line list of points; and 

means for obtaining an approximate volumetric representation of the object; 



means for producing a modified volumetric representation based on the start 
and end points of the set of lines. 

Preferably the system includes means for obtaining at least two two- 
dimensional images of the object and the object boundary positions are defined 
5 by edges of the object in the at least two two-dimensional images. 

Preferably'the system includes means for projecting the at least one set of 
lines into at least one of the images to determine which of the lines intersect the 
edges. 

Preferably, the means for obtaining is at least one camera. Preferably the 
10 system comprises means for receiving a plurality of measures of positions of the 
at least one camera. Preferably, the system comprises means for storing the 
plurality of measures of camera positions. 

An advantage of the present invention over the prior art is that it results in an 
ordered list stored over a 2D grid, and so simplifies processing in obtaining the 
1 5 volumetric representation of the object. 

According to a fourth aspect of the invention there is provided a method of 
providing a volumetric representation of a three-dimensional object, the method 
comprising: 

obtaining a line list of points of at least one set of lines having start and end 
20 points corresponding to intersection of the lines with object boundary positions; 
and 

producing the volumetric representation by correlating the start and end 
points of the set of lines to produce a continuous representation of the object. 

Preferably, correlating the start and end points comprises searching for 
25 neighboring points. Preferably, sets of at least three neighboring points are 
correlated to form sets of triangles. 

Preferably, lines are arranged over at least one two dimensional grid and at 
least some points are correlated by performing a search for neighboring points 
over the at least one two dimensional grid. 
30 According to another aspect of the present invention there is provided a 

computer program or computer program product for providing a volumetric 
representation of a three-dimensional object comprising means for performing the 
method steps of either of the method aspects. 



As will be appreciated by the person skilled in the art, a voxel is usually 
defined along orthogonal axes, typically of a cube, however it will be appreciated 
that for different applications of the invention, the voxels used may be of one or 
more different shapes, such as rectangular prism, tetrahedron, rhomboid, or of 
other three-dimensional polyhedron that are able to be part of an array where 
adjacent shapes share adjoining edges. For the purposes of the specification, 
unless otherwise defined, the term voxel therefore, is not to be limited to any 
particular shape. 

Preferred embodiments of the invention will now be described, byway of 
example only, with reference to the accompanying drawings in which: 

Figure 1 is a perspective view of a person posing for a prior art chroma-key 
image process used with the present invention; 

Figure 2 is the chroma-key image resulting from the process involved in 
Figure 1; 

Figure 3 is a schematic representation of a set of lines in accordance with 
the present invention; 

Figures 4, 5a-c and 8b are schematic representations of an application of 
line sets according to the present invention; 

Figure 6 is an array of voxels; 

Figure 7 is a single voxel; 

Figure 8a is a schematic representation of an application of a prior art 
method; 

Figure 9 is an example of a volumetric representation of an object using the 
marching cubes algorithm; 

Figure 10 is an example of a volumetric representation of an object using 
the present invention; 

Figure 1 1 is a graph displaying error comparisons of different models of 
methods for obtaining a volumetric representation of an object; and 

Figure 12 is a perspective view depicting a typical studio arrangement. 

Referring to Figures 1 to 7, 8b, 10 and 12, a preferred embodiment of the 
present invention comprises a method of providing a volumetric representation of 
a three-dimensional object 20. 
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In Figure 1 , an example of a person is given for the object 20. Of course, 
the object is not limited to people, but can be any object within reason. 

The method comprises several steps. The first step is to obtain two 
dimensional (2D) binary, or silhouette images 22 of the object 20, using an image 
5 segmentation technique to filter the image foreground from the image 

background. In the preferred embodiment, the method used employs a camera & 
conventional chroma-keying techniques, but in alternative embodiments other 
techniques, such as difference or luminous keying, may be used. This is 
achieved using a multi-camera studio system with known camera parameters, as 

10 described in our GB application no. 0220972.4. For example, Figure 2 illustrates 
a chroma-key representation of one view of the object 20 in front of a retro- 
reflective background 18 illustrated in Figure 1. In practice, six images of the 
object are preferably obtained from the chroma-keying, where the six images 
represent different side views of the object. However in alternative embodiments, 

1 5 the method may rely on two to five images, or more than six. 

A technique such as shape from silhouette, as described in "W. Niem, 
'Robust and fast modelling of 3D natural objects from multiple views', SPIE 
Proceedings, Image and Video Processing II, Vol 2182, pp 88-397, San Jose, 
February 1994" is particularly suitable for 3D reconstruction in this application. 

20 Alternative techniques may also be used. For example, for applications such as 
3D-photography with static objects, fewer cameras (or only one camera) may be 
used taking several pictures of the object by either fixing the camera and rotating 
the object on a turntable or by moving the camera around the object. For the 
latter, a tracking system is needed that gives the camera parameters. A suitable 

25 system for this is described in GB-A-2325807. 

Referring in particular to Figure 12, an example of a multi-camera studio 
system with known parameters is illustrated. Details of such components are 
described in GB 2325807; GB 2321814 and UK patent application number 
0206214.9, the disclosures of which are incorporated herein by reference. 

30 The system depicted in Figure 12 uses multiple cameras and chroma-key 

techniques to compute a 3D model of an actor 20. Studio cameras 23 are 
arranged to take images of the scene, including: at least one modified fixed 
camera 23a with an illuminator comprising a ring of blue LEDs for illuminating the 
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object from the camera direction so that the retro-reflective background 18 
reflects light back to the camera; and a similarly modified camera 23b with a 
tracking system. 

The next step is that of obtaining a line list of points using a computer. This 
5 is achieved by sampling the object by a set of line segments 24, as illustrated in 
Figure 3. For ease of calculation, the line segments 24 are organised into line 
segment sets S, organised in a 2D array. For example, the line segments 24 
illustrated in Figure 3 form a line segment set S(x 1i x 2 )- The line segments 24 of 
this set extend from a base 26 defined by axes x?=m and x 2 =n. The set S(x 1f x 2 ) - 
10 of segments 24 as illustrated in Figure 3 is only able to sample the surface of an 
object correctly along the continuous axis, i.e. in the direction of the line segments 
24, or along x 3 . Also, x 3 =0 to x 3 =x 3max is predetermined as being a length greater 
than the longest length of the object in the direction of x 3 . 

For each set, a list of line segments 24 is maintained for each position (m,n). 
15 As illustrated in Figure 3, each position (m,n) may correspond to no line 
segments, or one or more line segments 24. Each line segment 24 is 
characterised by its start and end points 28 and 30 respectively. 

The line segments 24 in a particular list assigned to position (m,n) lie on a 

line: 

20 g(m 9 n):x = x o + rx a 

To initialise the process of performing the step of projecting line segments 
into the silhouette images, a volume 32 is defined to surround the object 20. In 
the initial stage of the process, the volume is considered as entirely populated 
25 with one initial line segment for each column (m; n) covering the definition range 
0 <x 3 <x 3max of the volume. Referring for example to Figures 3 and 4, the entire 
algorithm for performing the step of projecting line segments into the silhouette 
images to determine the start and end points 28 and 30 for lines in each of the 
line sets is as follows: 



30 



1 : Initially a set S of major line segments 34 = (x 3(0 ),x 3max ), for all 
silhouette images 22. 



2: For all major line segments 34 in a given set S, project the major 
line segments 34 into one silhouetted object 36, where the projection is 
calculated with respect to the position of the camera that took the original 
image for silhouetted object 36 (in Figure 4, the focal direction of the camera 
is normal to the x and y axes). The result is a 2D major line segment 34, with 
end points 28a and 30a. 

3: For each major line segment 34, create a list of where the line 34 
intersects with an edge or edges 22 of the silhouetted object 36. (NB: this 
list will be empty if the major line segment 34 does not pass through, or 
intersect, the silhouetted object 36). 

4: Replace major line segments 34 in the given set S with 
corresponding line segments 24, in terms of their start and end points 28 
and 30 contained in the list of step 3, which will be defined with respect to 
projection base 26. 

5: Repeat steps 2 to 4 for remaining sets, where applicable. 

Usually, the line segments will be orthogonal to their respective plane from 
which they are projected, in a local line segment coordinate system. For a 
projection base in the xy plane, and continuous axis along the z-axis, the line 
equations are: 

g(m,n):(ms x ,ns y ,0) T + r(0,0,l) T 
where s x and s y are respective line spacings. 

Therefore, as illustrated in Figures 5a-c, to sample an object correctly in all 
directions, three respective sets S xy , Syz and Sxz of line segments are extended for 
all three Euclidian axes (in Figure 4a, set S xy is the set of line segments 24 going . 
into or out of the x,y plane). ' 

Therefore, the definition range for each line of the volume 32 in each of the 
Euclidian axes will be: for S^, 0 <x <x max ; for S xz , 0<y <y max ; and for 
S xy , 0 < z < z max . 

In the preferred embodiment, the next stage of the method involves 
obtaining an approximate volumetric representation of the object using a 
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computer. The preferred form of this stage of the method is using the marching 
cubes procedure, or algorithm, as discussed above. As will be appreciated by 
persons skilled in the art, other algorithms, or procedures may be used to obtain 
the approximate volumetric representation of the object in alternative 
embodiments. For example, a marching triangles procedure may be used 
("'Marching Triangles: Range Image Fusion for Complex Object Modelling', 
HiltonA, Stoddart,AJ., Illingworth.J. and Windeatt, T. IEEE 1996 International 
Conference on Image Processing".) 

The marching cubes algorithm uses an array of voxels 38 in a defined space 
that is predetermined to fit the object therein. An example of a voxel array 40 is 
illustrated in Figure 6, where eight vertices 42 define each voxel 38. In turn, each 
adjacent pair of vertices 42 defines a voxel edge 44 therebetween (see Figure 7). 

The silhouette images 22 can then be thought of as being projected into the 
voxels 1 space, or vice versa. It is then determined in which of the voxels 38 the 
object 20 is present, and through which of the voxels an edge 46 of the object 20 
passes. For the purpose of the specification, these latter voxels are termed 
"intersected voxels". It is also determined through which of the voxel edges 44 
the object edge 46 intersects. 

A list of the intersected voxels and their intersected edges (in terms of the 
voxel vertices 42 which define the respective voxel edge 44) is then compiled. 
This data is run through the remainder of the marching cubes algorithm, which 
firstly assumes the object edge 46 passes through a midpoint 48 of the voxel 
edge 44, and then reads a look-up table of fifteen variations of triangles having 
their vertices at the voxel edge midpoints 48 between adjacent voxel vertices and 
assigns one or two appropriate triangles to the given intersected voxel. For 
example, using the illustration of the voxel 38 illustrated in Figure 7, an edge of an 
object has passed between voxel vertices 42a-d, or through voxel edges 44a-c. 
Although the object edge 46 may have intersected edges 44a-c^t any point along 
the edges, the marching cubes algorithm assigns this voxel a triangle 50 with 
vertices 52 at edge midpoints 48. 

In the usual marching cubes procedure, the triangles 50 which make up the 
volumetric representation have their vertices at respective voxel edge midpoints 
48. However, in the preferred embodiment, data from the line segment sets S is 
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used to determine, where appropriate, where on the intersected voxels' edges the 
object edge 46 actually passes. That is to say, when calculating the triangle to be 
used in a particular intersected voxel, the positions of the triangle vertices 52 are 
retrieved from the line segment sets with the same orientation as the particular 
voxel edges 44 and are therefore based on a measured value, rather than a mere 
discrete value, as is the case with the marching cubes algorithm. For example, 
Figure7 illustrates the triangle 50 produced by the marching cubes algorithm, with 
midpoint vertices 52, whereas triangle 50a, corresponding to triangle 50, has 
vertices 52 at points not necessarily being voxel edge midpoints 48. 

A comparison of the outcome of using the marching cubes algorithm 
compared with the method of the present invention is illustrated in Figures 8a & b, 
9 and 10. Figure 8a illustrates the outcome of the marching cubes algorithm in 
one plane, of the object 20 illustrated in Figures 5a-c. As is illustrated, voxel 
vertices 42 shown in bold are deemed within the object 20. Also, the edge 44a of 
the marching cubes representation 54 passes through voxel edge midpoints 48. 
Figure 8b illustrates the use of two line sets Sxz and Syz which have been 
projected through plane xy, determining start and end points 28 and 30 of the line 
segments 24. These start and end points 28 and 30 show how the resultant 
representation 56 is a more accurate representation than when produced by the 
marching cubes algorithm alone. 

Figure 9 represents a marching cubes volumetric representation 54a of the 
object 20 in Figure i, and Figure 10 represents a volumetric representation 54b 
using the method of the present invention of the same object. On comparison of 
Figures 9 and 10, it is apparent that the method of the present invention has 
produced a more accurate representation of the object 20. 

The advantages of the present invention over the prior art are therefore 
quite clear to the skilled person. That is to say, utilising the method of the present 
invention results in a volumetric representation of improved apcuracy when 
compared with prior art methods, while at the same time the volumetric 
representation is defined by a relatively small data set. Also, the data set does 
not contain discrete information about the shape of the object, but continuous 
data. Therefore, real information about the object is not lost during use of the 
method, as it would be when using prior art methods. 
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In Figure 1 1 the number of triangles is shown over the measured model 
silhouette error. For the determination of the error the computed 3D volumetric 
representation is projected into the original image. The silhouette error is then 
computed as the ratio between the number of pixels where the model is incorrect 
and the total number of pixels of the real object silhouette. The required number 
of triangles which is controlled by increasing or decreasing the voxel size of the 
volumetric data set is depicted for three methods: using discrete voxels; using a 
line segment set in just one direction and for 3 line segment sets. For a silhouette 
error of approximately 8% the prior art approach needs 8144 triangles. Our 3-line 
segment set approach needs only 3586 triangles. The 1-line segment set 
approach is only occasionally better than the prior art approach because it gains 
only in one direction from the line segment representation and introduces the 
same quantisation noise as the prior art method in the other directions. The 
computation for the 3D polygon models with an error of 8% needs 1 .45 seconds 
for the conventional methods, 0.49 seconds for the 1 line segment set S and 
0.52 seconds for three line segment sets, on a computer using a Linux® operating 
system with a Pentium® IV Xeon® processor, running at 2.2 GHz. 

Furthermore, texture maps can be applied to the outcome of the method of 
the present invention to render a more realistic representation of the object 20. 

It will be appreciated by the skilled person that in alternative embodiments of 
the present invention, alternative methods to the marching cubes algorithm are 
employed for the step of obtaining a volumetric representation of the object. 

Also, another embodiment of the present invention provides a moving 
volumetric representation of the object. In this embodiment a plurality of 
volumetric representations of the three-dimensional object 20 are obtained using 
the method of the first described embodiment, where each volumetric 
representation represents a different phase of movement of the object 20 over 
time. To provide the moving volumetric representation, the volumetric , 
representations are displayed, usually on a computer, overtime to produce to a 
viewer the sensation that the volumetric representation of the object is moving. 

Another preferred embodiment of the invention provides a system for 
providing a volumetric representation of a three dimensional object 20. The 
system comprises means for obtaining silhouette images of the object, the means 
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being in the form of a camera and conventional chroma-key imaging equipment. 
The system also includes means for obtaining a line list of points of at least one 
set of lines having start and end points corresponding to intersection of the lines 
with object boundary positions; means for obtaining an approximate volumetric 
5 representation of the object; and means for producing a modified volumetric 
representation based on the start and end points of the set of lines. These 
means are in the form of a computer with software to process the line list, and 
obtain an approximate representation, according to the methods described 
above. Usually, the chroma-key imaging equipment is capable of providing digital 
1 0 information of the silhouette images 22 to the computer with software to process 
the line list. However, where the chroma-key imaging equipment only produces a 
printed copy of the silhouette images, these images are scanned using a 
conventional scanner to provide the digital information of the silhouette images 
22. 

15 In an alternative embodiment, rather than modifying an approximate 

volumetric representation, the start and end points of the lines may be used to 
form a continuous surface. This may be achieved by beginning with one of the 
start or end points and searching for adjacent, or neighbouring points to form a 
polygon. A 3D search may be performed, but an advantage of this method is 

20 that, because the lines are arranged in 2D grids, a more efficient 2D neighbouring 
point search may be performed. In a 2D search, the search along two grid axes 
in the plane of the grid may be used to locate the 3D coordinates of the 
neighbouring start or end point. For example, with reference to Figure 3, A 
search along the x1 ,x2 axes will enable start and end points of the lines to be 

25 correlated into lower and upper bounding triangles. Typically, three points will be 
correlated, or joined to form triangles, but polygons with more than three vertices 
may also be formed. The process is iterated over all available start and end 
points to form the volumetric representation. Although a 2D search may^be 
performed within grids, a 3D search may be necessary at the edge of each grid. 

30 While the present invention has been described in its preferred 

embodiments, it is to be understood that the words which have been used are 
words of description rather than limitation and that changes may be made to the 
invention without departing from its scope as defined by the appended claims. 
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Each feature disclosed in this specification (which term includes the claims) 
and/or shown in the drawings may be incorporated in the invention independently 
of other disclosed and/or illustrated features. 

The text of the abstract filed herewith is repeated here as part of the 
5 specification. 

The invention provides a method of providing a volumetric representation of 
a three-dimensional object. The method comprises several steps, including 
obtaining a line list of points of at least one set of lines having start and end points 
corresponding to intersection of the lines with object boundary positions and 

10 obtaining an approximate volumetric representation of the object. Then, a 
modified volumetric representation is produced by modifying the approximate 
volumetric representation based on the start and end points of the set of lines and 
the approximate volumetric representation. The resultant modified volumetric 
representation of the object is more accurate than the approximate volumetric 

15 representation of the object. Also, a resultant data set from the present invention 
that defines the volumetric representation of the object contains continuous data 
as to the shape of the object, rather than mere discrete data. Therefore, the 
resultant data set contains more realistic data defining the object. 
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CLAIMS 

1 . A method of providing a volumetric representation of a three- 
dimensional object, the method comprising: 

5 obtaining a line list of points of at least one set of lines having start and end 

points corresponding to intersection of the lines with object boundary positions; 
obtaining an approximate volumetric representation of the object; and 
producing a modified volumetric representation by modifying the 
approximate volumetric representation based on the start and end points of the 
10 set of lines and the approximate volumetric representation. 

2. The method of claim 1 wherein at least two two-dimensional images 
of the object are obtained and the object boundary positions are defined by edges 
of the object in the at least two two-dimensional images. 

15 

3. The method of claim 2 wherein the at least one set of lines is 
projected into at least one of the images to determine which of the lines intersect 
the edges. 

20 4. The method of claim 3 wherein the line list of points is determined 

by the points where the lines intersection the edges. 

5. The method of claim 4 wherein the set of points are start and end 
points of line segments of the lines that intersect the edges. 

25 

6. The method of any one of claims 2 to 5 wherein the approximate 
volumetric representation is obtained by projecting the at least two images of the 
object into an array of voxels, determining in which of the voxel(s) one or more of 
the edge(s) of the object intersects therewith, and producing a voxel list thereof. 

30 

7. The method of claim 6 wherein the line list(s) are used to determine 
at least some locations on voxel edges of respective voxels in the voxel list to 
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produce a voxel edge intersection list, and wherein the voxel edge intersection list 
is used to produce the modified volumetric representation. 

8. The method of claim 6 when appended to claim 5 wherein the start 
and end points of the line segments are used to determine at least some 
locations on voxel edges of respective voxels in the voxel list to produce a voxel 
edge intersection list, and wherein the voxel edge intersection list is used to 
produce the modified volumetric representation. 

9. The method of any one of the preceding claims wherein the 
modified volumetric representation is produced to have at least some voxel edges 
which more accurately match object edges than in the approximate 
representation. 

10. The method of any one of the preceding claims wherein the 
approximate volumetric representation is obtained using a marching cubes 
procedure. 

11. The method of claim 10 wherein the start and end points are used 
to modify the spatial positions of triangle vertices of triangles produced by the 
marching cubes procedure on the triangle vertices 1 respective voxel edges. 

12. The method of any one of claims 2 to 1 1 wherein the images are 
produced from a chroma-key process. 

13. The method of claim 12 wherein the initial images are obtained 
using one or more cameras in a studio. 

14. The method of claim 13 wherein the studio includes a retro- 
reflective background behind the object. 
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1 5. The method of any one of claims 5 to 14 wherein the start and end 
points and the position and direction of the lines are estimated with respect to a 
position of the camera when obtaining the images. 

16. The method of any one of claims 5 to 15 including receiving and/or 
storing a plurality of measures of camera positions. 

1 7. The method of any one of claims 5 to 1 6 wherein at least one 
camera position is dynamically obtained. 

1 8. The method of any one of claims 1 2 to 1 7 including 3 pairs of 
images, wherein the images of each pair lie in a parallel plane, and the plane of 
each respective image of each pair is normal to the planes of the remaining pairs. 

1 9. The method of any one of the preceding claims wherein a texture 
map is applied to the volumetric representation. 

20. A method for providing a moving volumetric representation of an 
object, the method comprising obtaining a plurality of volumetric representations 
of a three-dimensional object using the method of any one of the preceding 
claims, where each volumetric representation represents a different phase of 
movement of the object over time, and consecutively displaying each volumetric 
representation in a manner to produce to a viewer the sensation that the 
volumetric representation of the object is moving. 

21 . A system for providing a volumetric representation of a three 
dimensional object, the system comprising: 

means for obtaining an -approximate volumetric representation of the 

object; 

means for obtaining a line list of points of at least one set of lines having 
start and end points corresponding to intersection of the lines with object 
boundary positions; 

means for storing the line list of points; and 
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means for producing a modified volumetric representation based on the 
start and end points of the set of lines. 

22. The system of claim 21 including means for obtaining at least two 
two-dimensional images of the object and the object boundary positions are 
defined by edges of the object in the at least two two-dimensional images. 

23. The system of claim 22 including means for projecting the at least 
one set of lines into at least one of the images to determine which of the lines 
intersect the edges. 

24. The system of claim 22 or 23 wherein the means for obtaining is at 
least one camera. 

25. The system of claim 24 comprising means for receiving a plurality of 
measures of positions of the at least one camera. 

26. The system of claim 25 comprising means for storing the plurality of 
measures of camera positions. 

27. A method of providing a volumetric representation of a three- 
dimensional object, the method comprising: 

obtaining a line list of points of at least one set of lines having start and end 
points corresponding to intersection of the lines with object boundary positions; 
and 

producing the volumetric representation by correlating the start and end 
points of the set of lines to produce a continuous representation of the object. 

28. The method of claim 27 wherein correlating the start and end points 
comprises searching for neighbouring points. 

29. The method of claim 28 wherein sets of at least three neighbouring 
points are correlated to form sets of polygons. 
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30. The method of any one of claims 27 to 29 wherein lines are 
arranged over at least one two-dimensional grid and at least some points are 
correlated by performing a two-dimensional search for neighbouring points over 

5 the at least one two dimensional grid. 

31 . A computer program or computer program product for providing a 
volumetric representation of a three-dimensional object comprising means for 
performing the method of any one of claims 1 to 20 or 27 to 30. 

10 

32. A method of providing a volumetric representation of a three- 
dimensional object substantially as herein described with reference to Figures 1 
to 7, 8b and 10 of the accompanying drawings. 
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ABSTRACT 

The invention provides a method of providing a volumetric representation of 
a three-dimensional object. The method comprises several steps, including 
obtaining a line list of points of at least one set of lines having start and end points 
corresponding to intersection of the lines with object boundary positions and 
obtaining an approximate volumetric representation of the object. Then, a 
modified volumetric representation is produced by modifying the approximate 
volumetric representation based on the start and end points of the set of lines and 
the approximate volumetric representation. The resultant modified volumetric 
representation of the object is more accurate than the approximate volumetric 
representation of the object. Also, a resultant data set from the present invention 
that defines the volumetric representation of the object contains continuous data 
as to the shape of the object, rather than mere discrete data. Therefore, the 
resultant data set contains more realistic data defining the object. 

(Figure 10) 
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Figure 4 
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Figure 7 
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Figure 8a 



Figure 8b 
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Figure 1 1 
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